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Abstract — We characterize the capacity region to within 
log {2(M 1)} bits/s/Hz for the M -transmitter Tf-receiver Gaus- 
sian multicast channel with feedback where each receiver wishes 
to decode every message from the M transmitters. Extending 
Cover-Leung's achievable scheme intended for {M, K) = (2, 1), 
we show that this generalized scheme achieves the cutset-based 
outer bound within log{2(A/ 1)} bits per transmitter for all 
channel parameters. In contrast to the capacity in the non- 
feedback case, the feedback capacity improves upon the naive 
intersection of the feedback capacities of K individual multiple 
access channels. We find that feedback provides unbounded 
multiplicative gain at high signal-to-noise ratios as was shown in 
the Gaussian interference channel. To complement the results, 
we establish the exact feedback capacity of the Avestimehr- 
Diggavi-Tse (ADT) deterministic model, from which we make 
the observation that feedback can also be beneficial for function 
computation. 

Index Terms — ADT Deterministic Model, Feedback Capacity, 
Function Computation, Gaussian Multicast Channel 



I. Introduction 

While feedback plays a significant role in improving the 
reliability of communication systems (TJ, a traditional view- 
point on feedback capacity has been pessimistic over the past 
few decades. This is mainly due to Shannon's original result 
on feedback capacity which shows that feedback provides no 
increase in capacity for discrete memoryless point-to-point 
channels [2]. For multiple-access channels (MACs), feedback 
can increase the capacity [3 1; however, the increase in capacity 
for Gaussian MACs is bounded by 1 bit for all channel 
parameters |0] . 

In contrast to these results, recent research shows that 
feedback provides more significant gain for communication 
over interference channels fl5] — flTj . Interestingly, the feedback 
gain is shown to be unbounded for certain channel parameters; 
i.e., the gap between the feedback and non-feedback capacities 
can be arbitrarily large as the signal-to-noise ratio (SNR) of 
each link increases. One distinction of interference channels 
with respect to MACs is that each receiver decodes its desired 
message in the presence of undesired interfering signals. A 
natural question to ask is whether feedback gain depends 
crucially on the presence of interference. 
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In this paper, we make progress towards addressing this 
question. To isolate the interference issue, we start with 
a Gaussian MAC with two transmitters and feedback. We 
then modify the channel by adding additional receivers with 
identical message demands and feedback links from those 
receivers to the two transmitters. We call the new channel the 
two-transmitter, if -receiver Gaussian multicast channel with 
feedback^ Note that this channel does not pose any inter- 
ference while still maintaining the many-to-many structure of 
interference channels. We present a coding scheme for this 
channel which generalizes Cover-Leung's scheme (intended 
for MACs) [ 10 1, and achieves rates within 1 bit/s/Hz per trans- 
mitter of the cut-set outer bound for all channel parameters. 
We further extend our results for the case of M -transmitters 
and approximate the feedback capacity within log {2(Af — 1)} 
bits/s/Hz per transmitter. We find that feedback can provide 
multiplicative gain in the high-SNR regime, and that feedback 
is useful not only for mitigating interference J6], but also for 
providing qualitatively-similar gains for channels with a many- 
to-many structure. In particular, we find that the feedback ca- 
pacity region strictly enlarges the intersection of the feedback 
capacity regions of K individual MACs. This is in contrast to 
the non-feedback case where the capacity region is simply the 
intersection of K individual MAC capacity regions. 

To complement our results on approximate feedback ca- 
pacity, we establish the exact feedback capacity region of the 
Avestimehr-Diggavi-Tse (ADT) deterministic model. As a by- 
product, we also find that feedback increases the achievable 
rates for function computation. Specifically using a two- 
transmitter two-receiver example where each receiver wants 
to reconstruct a modulo- 2 sum of two independent Bernoulli 
sources generated at the two transmitters, we demonstrate that 
feedback can increase the non-feedback computing capacity. 

Related Work: Feedback strategies for MACs were studied 
previously in Q], 0, lfT0l - lfT3l . For the two-user case, Cover 
and Leung [10] developed an achievable scheme that employs 
block Markov encoding and a decode-and-forward scheme. 
Willems ifTTI proved the optimality of this scheme for a 
class of deterministic channels. Ozarow |@] established the 
exact feedback capacity region using a different approach 
based on Schalkwijk-Kailath's scheme 1 1]. Kramer developed 
more generic techniques of the approach and extended the 



'In the non-feedback case, this channel is well known as the compound 
MAC 1 8 1, |9|. However, this name is not appropriate in the feedback case. 
The compound MAC has a single physical receiver which can feed back only 
one of the possible candidates of the received signals experiencing different 
channel states. In our model, on the other hand, all of the received signals 
can be fed back. 
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encoded signal X m i of transmitter m at time i is a func- 
tion of its own message and past feedback signals: X n 



z K ~ CM(o, 1) 



Fig. 1 . A Gaussian multicast channel with M = 2 transmitters and feedback 
from K receivers. 



result to include an arbitrary number of transmitters [0. In 
the present paper, we generalize Cover-Leung's scheme to 
approximate the feedback capacity region of the M -transmitter 
if -receiver Gaussian multicast channel with an additional 
(K — 1) receivers as well as corresponding feedback links 
from those receivers to the M transmitters. 

The two-user compound MAC with conference encoders ||8] 
or decoders J9] is also partially related to our work in the sense 
that dependence between the transmitted signals (or received 
signals) can be created through conferencing encoders (or 
decoders). However, we find a significant distinction. In the 
conferencing encoder problem []8], lfl4l . the capacity region 
is shown to be the intersection of the capacity regions of 
individual MACs. Similar behaviors follow for a class of 
conferencing decoder problems [9|. In contrast, we find that 
the feedback capacity region of our multicast channel enlarges 
the intersection of the feedback capacity regions of individual 
MACs. 

Recently, Lim-Kim-El Gamal-Chung developed an achiev- 
able scheme for discrete memoryless networks [15], and 
demonstrated the approximate optimality of their scheme for 
multi-source Gaussian multicast networks. Our feedback chan- 
nel with unfolding can be cast into a multi-source Gaussian 
multicast network. However, we exploit the structure of our 
feedback channel to induce correlation between transmitters 
which leads to a tighter result. 

II. Model 

We focus on the Gaussian multicast channel with M = 2 
transmitters and K receivers first. Section IIV-CI includes our 
results for M > 2. As shown in Fig. Q] each receiver decodes 
all of the messages and is able to feed its received signal back 
to both transmitters. Without loss of generality, we normalize 
the transmit signal powers as Pi = P 2 = 1 and channel noise 
powers as Z k ~ CM(0, 1) for all k € {1, 2, . . . K}. Hence, the 
signal-to-noise ratio (SNR) at each receiver captures the effect 
of the channel gains: SNR m fc = |g m fc| 2 , where g m k G C is the 
complex-valued channel gain from transmitter m to receiver 
k. 

Each transmitter m G {1, 2} encodes an independent and 
uniformly distributed message W m € {1, 2, . . . , 2 NRm }. The 
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where Y k i is the received signal at receiver k at time i. A rate 
pair (Ri,R 2 ) is said to be achievable if there exists a family 
of codebooks subject to power constraints and corresponding 
encoding/decoding functions such that the average decoding 
error probabilities go to zero as the code length N tends to 
infinity. The capacity region C is the closure of the set of the 
achievable rate pairs. 

III. Main Results 

Theorem 1 (Inner Bound): The capacity region includes 
the set TZ of (Ri,R 2 ) such that for < p < 1 and Vfc, 



Ri <log^l + (l-p)^SNRiij 
R 2 <logfl + (l-p)^SNR 2i J 



(1) 



(2) 



Ri+R 2 < log (l + SNR lfc + SNR 2fc + 2 Pv /SNR lfc ■ SNR 2fe 

(3) 



Proof: See Section IW^Al ■ 
Remark 1: We compare this to the naive rate region which 
is the intersection of the feedback capacity regions of individ- 
ual MACs: 

0<p<l k=l 

where Cj^ AC (/9) denotes the feedback capacity region of the 
Gaussian MAC for receiver k, given p |4j. Note that the 
intersection constrains individual rate bounds, thus reducing 
the rate region. On the other hand, our rate region contains no 
such individual rate bounds, thus improving upon lZ n3 \ ve . This 
is in contrast to the nonfeedback case and the compound MAC 
case with encoders J8| (or decoders [9]), where the capacity 
region is simply the intersection of individual MAC capacity 
regions. □ 

Theorem 2 ( Outer Bound): The capacity region is included 
by the set C of (R X ,R 2 ) such that for < p < 1 and Vfc, 



Ri <log^l + (l-p 2 )^SNRi^ 
R 2 <log^l + (l-p 2 )^SNR 2 ^ 



(4) 
(5) 



Ri+R 2 < log + SNR lfc + SNR 2fc + 2/VSNR lfc • SNR 2fc 

(6) 



Proof: See Section USE ■ 
Corollary 1 (One Bit Gap): The gap between the inner 
bound and outer bound regions given in Theorems Q] and [2] 
is at most 1 bit/s/Hz/transmitter: 

KCCCKffi([0,l] x [0,1]). 
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Fig. 2. The gap between the symmetric-rate inner and outer bounds for a 
two-receiver symmetric channel setting: SNRi := SNRn = SNR22 and 
SNR 2 := SNR12 = SNR21 



Proof: The proof is immediate. Let <5i = Q — JT]). 
Similarly we define <5 2 and 8\2- Straightforward computation 
then gives 5% < log(l + p) < 1. Similarly, we get 82 < 1 and 
<5i2 = 0. This completes the proof. ■ 

Remark 2: Fig. [2] shows a numerical result of the inner- 
and-upper bound gap for the symmetric capacity, denoted 
by Csym = sup {R : (R, R) 6 C}. For illustrative purpose, 
we consider a two-receiver symmetric channel setting where 
SNRi := SNRn = SNR 22 and SNR 2 := SNRi 2 = SNR 2 i. 
While the worst-case gap is 1 bit due to the coarse analysis in 
Corollary Q] the actual gap is upper-bounded by approximately 
0.08 over a wide range of channel parameters. This suggests 
that a refined analysis could lead to an even smaller gap. For 
instance, in the high-SNR regime, we obtain the asymptotic 
symmetric capacity as follows. □ 

Corollary 2: For a two-receiver symmetric channel setting, 
the symmetric capacity at the high SNR regime is 



a 



' sym « i log (SNRi + SNR 2 + 2VSNR1 • SNR 2 ) . (7) 

Proof: Due to the high-SNR assumption, it follows that 
the optimal correlation coefficients for the inner and upper 

■ v /SNRi+ SNR 2 +2v'SNRi-Sn1? 



bounds are 
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SNR1+SNR2 

respectively, resulting in the matching inner and upper bound 
as ©. ■ 

Feedback Gain: From Theorems Q] and [5] we can see that 
feedback can provide a significant capacity increase as was 
shown in the Gaussian interference channel J6). To see this 
clearly, let us consider the two-receiver symmetric channel 
setting as above. Fig. [5] plots the high-SNR-regime symmetric 
capacity normalized by the MAC symmetric capacity for Rx 
1, denoted by C*^ = \ log (1 + SNRi + SNR 2 ). Here we 
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Fig. 3. Feedback gain for a two-receiver symmetric channel setting as 
in Fig. [2] Note that feedback provides unbounded multiplicative gain when 
SNRi is far apart from SNR 2 . 



min{iog SNRi jog Snr 2 } ^ X _ RX ^ S t0 indicate a signal 

maxjlog SNRi Jog SNR 2 1 & 

difference between SNRi and SNR 2 . Note that the 



use a 

strength difference 
symmetric nonfeedback capacity is simply the intersection of 
individual MAC capacities: 
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min logfl 

i=1.2 



SNRi),ilog(l 



SNRi +SNR 2 ; 



Note that the gap between C S y° and Cj^, can be arbitrarily 
large when SNRi and SNR 2 are far apart, i.e., a<\. On the 
other hand, the symmetric feedback capacity is asymptotically 
the same as if there were only one receiver. As a result, 
feedback provides multiplicative gain for the regime of a < i. 
In Section IIV-AI we will provide an intuition behind this gain 
while describing an achievable scheme. □ 



IV. Gaussian Channel 
A. Achiev ability: Proof of Theorem Q] 

Motivating Example (Fig. |4): To develop an achievable 
scheme for the Gaussian channel, we utilize the ADT deter- 
ministic model lfl6l illustrated in Fig. as an intermediate 
yet insightful model. The ADT multicast channel with M 
transmitters and K receivers is characterized by MK values: 
n m k, 1 < rn < M, 1 < k < K where n m k indicates the 
number of signal bit levels from transmitter to to receiver k. 
These values correspond to the channel gains of the Gaussian 
channel in dB scale: n m k — Ll°gSNR m feJ. See [16| for 
explicit details. 

We first explain an achievable scheme for a particular ADT 
model example, illustrated in Fig. |4] Specifically, we show 
how to achieve a (1.5,1.5) rate-pair with feedback. As will 
be seen in Theorem [5] the feedback capacity region is given 
by Ri + R 2 < 3. Extrapolating from this example, we later 
make observations leading to a generic achievable scheme. 

In the nonfeedback case, transmitter 1 can send only one bit 
ai through the top level, since the mincut between transmitter 
1 and receiver 2 is limited by 1. Similarly transmitter 2 can 
send only one bit, say b\. However, feedback provides more 
options to route by creating additional paths, e.g., [Txl —> 
Rxl -> feedback Tx2 Rx2]. This additional path 
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Fig. 4. Motivating example: An achievable scheme for a (1.5, 1.5) rate-pair. 



enables an increase over the nonfeedback rate. Transmitter 
1 squeezes one more bit Ai in the second level. Similarly 
transmitter 2 squeezes Bi in its own second level. Receiver 
1 then gets Ay, while receiver 2 does not. Similarly By is 
received only at receiver 2. We will show that these A\ and 
B\ can also be delivered to the other receivers with the help 
of feedback. At the beginning of time 2, transmitter 1 can 
decode B\ with feedback. Similarly transmitter 2 can decode 
A\. In time 2, transmitters 1 and 2 start with sending their own 
fresh information a,2 and &2 on the top levels respectively. Now 
the idea is that transmitter 1 forwards the fed back B\ using 
the second level. Note that this transmission allows receiver 
1 to obtain B\ without causing any harm to the transmission 
of (02,62)- Similarly transmitter 2 can deliver A\ to receiver 
2. Therefore, during the two time slots, transmitters 1 and 2 
can deliver (0,1,0.2, Ay) and (61,62,-81) respectively to both 
receivers, thus achieving (1.5, 1.5). 

Remark 3: The gain comes from the fact that feedback 
creates alternative paths to provide routing gain. In fact, this 
gain was already observed by [6| in the context of two- 
user strong interference channels where ni2 > nyy and 
n.21 > n.22 in the ADT model. However in (6), this routing 
gain does not appear in the weak interference regime such as 
(rii2 = 1 < nyy = 3, TI21 = 1 < n.22 = 3). On the other hand, 
in our multicast channel, we can see this routing gain even 
when cross links are weaker than direct links. □ 

This example leads us to make two observations. First, 
feedback enables each transmitter to decode the other transmit- 
ter's information and then forwards this in the next time slot. 
Second, the transmitted signals in time 2 can be correlated 
with the previously-sent information. This motivates us to 
employ the decoding-and-forward and block Markov encoding 
schemes. In fact, an achievable scheme combining these two 
ideas was developed by Cover-Leung iflOl in the context of 
the two-user discrete memoryless MAC with feedback. In this 
paper, we generalize this scheme to the multiple-receiver case, 
thereby obtaining an approximate capacity region within a 
provably small gap. As for a decoding operation, we employ 
backward decoding ifTTl . 

Here is the outline of achievability. We employ block 
Markov encoding with a total size B of blocks. In block 1, 



each transmitter sends its own information. In block 2, with 
feedback, each transmitter decodes the other user's information 
(sent in block 1). The two previously-sent messages are 
then available at each transmitter. Conditioning on these two 
messages, each transmitter generates its own fresh message 
and then sends a corresponding codeword. Each transmitter 
repeats this procedure until block B — 1, In the last block 
B, to facilitate backward decoding, each transmitter sends a 
predetermined message. Each receiver waits until a total of 
B blocks have been received and then performs backward 
decoding. 

The achievable scheme outlined above is broadly applicable 
and not limited to the Gaussian channel. We characterize an 
achievable rate region for discrete mememoryless multicast 
channels in Lemma Q] and then choose an appropriate joint 
distribution to obtain the desired result. The generic coding 
scheme is also applicable to the ADT deterministic model and 
details will be presented in Section [V] 

Lemma 1: The feedback capacity region of the two- 
transmitter if -receiver discrete memoryless multicast channel 
includes the set of (Ri,R 2 ) such that 

Ry<I(Xy,Yy,--- ,Y K \X 2 ,U) (8) 
R 2 <I(X 2 ;Y 1 ,---,Y K \X 1 ,U) (9) 
Ry+R 2 <I(Xy,X 2 ;Y k ),Vk (10) 

over all joint distributions p(u)p(xy\u)p(x2\u). Here U is a 
discrete random variable which takes on values in the set U 
where \U\ < min{|*i||Ar a |, • • • ,|M + 2. 

Proof: See Appendix lAl ■ 
We now choose the following Gaussian input distribution to 
complete the proof: Vrn = 1,2, 



U ~ CN(Q, p): X m ~ CAf(0, 1-p), 



(11) 



where X m = U + X m and (U, Xy,X 2 ) are independent. 
Straightforward computation then gives dTJ-(j3j. This com- 
pletes the proof. 

B. Outer Bound: Proof of Theorem [2] 

By symmetry, it suffices to prove the bounds of and ©. 
These bounds are based on standard cut-set arguments. 

Assume that the covariance between Xi and X2 is 
E[XiX2] = p- Starting with Fano's inequality, 

N(Ri - e N ) < I(Wi;Yi N , ■ ■ ■ , Yg, W 2 ) 

^^(Yh,--- ,Y Ki \W 2 ,Yr\--- ,*k 
-h(Y u ,--- ,Y Kl \Wi,W2iY[- x , 



• Y\s , X21) 



,Y Ki \X 2 



h(Zi 



■ , Y % K ,X 2 i,Xii) 
,Z Ki )] 



K 



< N\og 1 + (1- H 2 )^SNR lfc 

V fc=i / 



where (a) follows from the fact that Wy is independent of 

,5T X ); W 



W2, and X mi is a function of (W m ,Yl~ 
follows from the fact that conditioning reduces entropy and 
channel is memoryless; and (c) follows from the fact that 
\K Yi ,-,y k \x 2 \ < l+(l-|p| 2 )EfcSNRi fc .Ifi2i is achievable, 
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,Y% ,Xu,X2i)] 



then €m —> as N tends to infinity. Therefore, we get the 
desired bound. 

For the sum-rate outer bound, 

N(Ri +R2- e N ) < I(Wi,Wr,YF) 

< J2l h ( Y u) - h(Y lt \W 1 ,W 2 ,Y;- 1 

< ^Vlog (l + SNRn + SNR21 + 2|p|VSNRn ■ SNR 2 i" 

where (a) follows from the fact that conditioning reduces en- 
tropy; (b) follows from the memoryless property of channels; 
and (c) follows from the fact that \K Yl \ < 1 + SNRn + 
SNR 21 +2|HVSNRii -SNR 2 i. 

C. Generalization to M -transmitter Case 

Theorem 3 (Inner Bound): The feedback capacity region of 
the ^/-transmitter if -receiver Gaussian multicast channel in- 
cludes the set TZm of (i?i, • • • , Rm) such that for < p < 1, 
VS C {!,•■• ,M} and Vfc, 



y-i— 1 -yi-l 

1 1 '."■'k 



Yi nn 



^2R m <log\I K + (l-p)G s G* £ 



(12) 



mE«S 
M 



A I 



R m < log 1 + SNRmk + *VSNR mfc ■ SNR, 

m=l \ m=l m^n 

(13) 

where G5 is such that 



Y = G S X S + G s cX s c + Z. 

K - X s := [X m Y G d s l,m G 



G 
V 



Here F := [ Yi , • • • ,Yk 
5; and Z := [Zi,--- ,Z K 

Proof: We first generalize Lemma Q] as follows. 
Lemma 2: The feedback capacity region of the M- 
transmitter if-receiver discrete memoryless multicast channel 
includes the set of (Ri, ■ ■ ■ , R M ) such that VS C {1, • • • , M} 
and Vfc, 



A I 



R m <I{X s ;Y u --- ,Y K \X S c,U) 



^ Rm < ^(^1, • • ■ , Xm] Yk) 
m— 1 

over all joint distributions p(u) Y[ m —i p(x m \u). Here U is a 
discrete random variable which takes on values in the set U 
where \U\ < min{|*i||*2| • ■ • \X M \, |M • • • ,|^|} + 2. 

Proof: For M > 2, a multitude of auxiliary random 
variables can be incorporated to capture correlation between 
many transmitter pairs. For simplicity, however, we consider 
a natural extension of the two-transmitter case which includes 
only one auxiliary random variable. The only distinction is that 
with feedback, each transmitter decodes all of the messages 
of the other transmitters, and generates its new message and a 
corresponding codeword, conditioned on all of these decoded 
messages. This induces a multitude of constraints on the rate 
region. To avoid significant overlaps, we omit the detailed 
proof. ■ 



$ TlMl 
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Fig. 5. An ADT multicast channel with M transmitters and K receivers 
providing noiseless feedback. 



We now choose the following Gaussian input distribution to 
complete the proof: Vrn = !,••• , M, 



U ~ CAA(0, p); X m ~ CAf{0, l-p), 



(14) 



where X m = U + X m and (U,Xi, - ■ ■ ,Xm) are indepen- 
dent. Straightforward computation then gives (TTZt-dOV This 
completes the proof. ■ 
Theorem 4 ( Outer Bound): The feedback capacity region 
of the Ai-transmitter if -receiver Gaussian multicast channel is 
included by the set Cm of (i?i, • • • ,Rm) such that VKx '■= 
E[XX*] t 0, VS C {1, • • • , M} and Vfc, 

^ lo S Vk + G s K slS cG* s \ (15) 

M I M 

Y R ™<\0gll+Y SNR ™fc + Y Pm«VSNR mfc -SNR nfc 

m=l \ m=l m^n 

(16) 

where K S \ S c denotes the conditional co variance matrix of Xs 
given X S a and p mn := |[ifx]mn|- 

Proof: As before, the proof of the outer bounds are based 
on the standard cutset argument. Hence, we omit the detailed 
proofs. ■ 
Corollary 3 (Constant Gap): The gap between the inner 
bound and outer bound regions given in Theorems [3] and Q] is 
upper-bounded by A := log {2(M — 1)} bits/s/Hz/transmitter: 

Tlu C Cm C K m © ([0, A] x ■ ■ • x [0, A]) . 

Proof: See Appendix iBl ■ 

V. Deterministic Channel 

The ADT model was developed as a method of analysis 
to approximate the feedback capacity region of the Gaussian 
multicast channel. In this section, we find the exact feedback 
capacity region of the deterministic channel. 

Theorem 5: The feedback capacity region of the M- 
transmitter if -receiver ADT multicast channel is the set of 
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(Rx, ■ ■ ■ , Rm) such that VS C {1, • ■ ■ , M} and Vfc, 

^ Rm < rank(G 5 ) (17) 

M 

y^R m < max{w lfc , ■ ■ ■ ,n Mk } , (18) 

m— 1 

where G5 is such that Y = GgXg + Gs^Xgo. 

Proof: The achievability proof is immediate due to 
Lemma |2 The achievable region is maximized when U = 
and (Xx, ■ • • , Xm) are uniformly distributed and independent. 
Appendix [C] contains the converse proof. ■ 

VI. Function Computation 

As a by-product of Theorem [5] we can find an interesting 
role of feedback for other communication scenarios such as 
computation in networks. To see this, consider an (M, K) = 
(2, 2) ADT multicast channel with feedback and parameters 
nxi = ri22 = 3 and 11x2 = "21 = 1 (see Fig. Suppose that 
both receivers wish to compute the same function of modulo-2 
sums of two independent Bernoulli sources (Si, S2) generated 
at the two transmitters. The computing rate for decoding Si © 
S2 at all receivers is denoted i? C omp- Without feedback, the 
following cut-set based argument provides a bound on i? C omp: 

N(R comp -e N ) <I(S 1 ®S 2 ;Y 1 N ) 

< I(Sx 8 S 2 ; Yf, Si) = /(Si © S 2 ; Y^SuX?) 

where the equality follows from the fact that Si © S2 is inde- 
pendent of Si. For the particular ADT example, H(Yx\Xx) < 
1 and H(Y 2 \X 2 ) < 1, from which i? comp < 1. On the 
other hand, the example in Fig. [4] shows the achievability 
of (|, |), thus yielding i?^f mp > §■ Therefore, feedback can 
increase rates for computation. Our future work is to extend 
this example to larger classes of networks. 

VII. Conclusion 

We established the feedback capacity region of the Gaussian 
multicast channel with M transmitters and K receivers to 
within log{2(M — 1)} bits/s/Hz per transmitter of the cutset 
bound universally over all channel parameters. We character- 
ized the exact feedback capacity region of the ADT model, 
and observed a feedback gain for function computation. 

Our future work is along several new directions: (1) Improv- 
ing our coding scheme based on Cover-Leung to incorporate 
ideas from J4), HZ), fl~3), flT8 1 ; (2) Extending to more realistic 
scenarios where feedback is offered through rate-limited bit- 
piped links Ifl9l or a corresponding backward channel [20 1 ; 
(3) Exploring the role of feedback for function computation. 

Appendix A 
Proof of LemmaQ] 

Codebook Generation: Fix a joint distribution 

p(u)p(xx\u)p(x2\u). First generate 2 N ^ Rl+R2 ^ independent 
codewords u N (^,l), j € {l,--- ,2 NRl }, I € {1, • • • ,2^}, 
according to Yii=x P( u i)- F° r eacn codeword u N (j, I), encoder 



1 generates 2 NRl independent codewords x± ((j, I), s), 
s G {l,--- ,2 NRl }, according to YiiLxP( Xli \ Ui )- Similarly, 
for each codeword u N (j,l), encoder 2 generates 2 NR2 
independent codewords ((j,l),q), q E {L-- - ,2 NR2 }, 
according to Yl i=1 P( x 2i\ui)- 

Encoding and Decoding: We employ block Markov en- 
coding with a total size B of blocks. Focus on the &th 
block transmission. With feedback (yf^ b )2/r- )> 

transmitter 1 tries to decode the message w 2 b ^ = q (sent 
from transmitter 2 in the (b — l)th block). In other words, we 
find the unique q such that 

(«* (ur 2 ur 2) ) ,*? ((wt^A'-^t 1 ') > 

where Ae indicates the set of jointly typical sequences. 
Note that transmitter 1 already knows its own messages 
(w^ 2 \ Wi We assume that w 2 b 2 "* is correctly decoded 
from the previous block (6—1). The decoding error occurs if 
one of two events happens: (1) there is no typical sequence; 
(2) there is another such that it is a typical sequence. 

By AEP, the first error probability becomes negligible as N 
tends to infinity. By the packing lemma in ||2TI . 11221 . the 
second error probability becomes arbitrarily small (as N tends 
to infinity) if 

R 2 <I(X 2 ;Y 1 ,---,Y K \X 1 ,U). (19) 

Based on (w^ ^^w^ ), transmitter 1 generates a new 
message and then sends ([w < ^~ 1 \w 2 b ^),w^^. 

Similarly transmitter 2 decodes , generates w 2 and 

then sends (^(w^ ^jW^ V ' ') , w^j ■ 

Each receiver waits until total B blocks have been received 
and then does backward decoding. Notice that a block index 
b starts from the last B and ends to 1. For block b, receiver k 
finds the unique pair (j, I) such that 

(u N (jj),x?((ll)Ax b) ), 

where we assumed that a pair of messages (w^ , ) was 
successively decoded from block (b + 1). Similarly other 
receivers follow the same decoding procedure. 

Error Probability: By symmetry, we consider the proba- 
bility of error only for block b at receiver k. We assume that 
(w^ 1 \ w 2 b ) = (1, 1) was sent through block (b — 1) and 
block b; and there was no backward decoding error from block 
B to (6+ 1), i.e., (w^ , ) are successfully decoded. 

Define an event: 

E jl = {(u N {j,l)^{{j,l)Ax\ 

By AEP, the first type of error becomes negligible. Hence, we 
focus only on the second type of error. Using the union bound, 
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we get 



Pr 



|J E fl < e Pr (^) 

+ e E Pr (^) 

3^1,1=1 3=1,^1 
< 3 . 2N(R.i + R2-I(U,X u X 2 ;Yk)+3e) 



Here note that (j ^ 1,1 ^ 1) is the worst case, dominating 
the other two cases. The number 3 in the second inequality 
reflects all of these cases. Hence, the error probability can be 
made arbitrarily small if 



Ri + R 2 <I(X 1 ,X 2 ;Y k ),Vk. 
From dT9l i and d2H . we complete the proof. 



(21) 



Appendix B 
Proof of Corollary[3] 

Let S s = ([15]) - H2). Set p = min m ,„ py. We then get 

5 S = log \I K + G s K sls M* s \ - log \I K + (1 - p)G s G* s \ 

< log \I K + \S\(l - p 2 )G s G* s \ - \og\I K + (1 - P )G S G* S \ 

( = 5 log | J| S | + |5|(1 - p 2 )G s G s \ - log |J| S | + (1 - P )G* S G S \ 
<log|(l + p)|5|7| S || 
= |<S|log|(l + p)|<S|| 

< |<S|log{2(M-l)} 

where (a) follows from Claim 1 (see below); and (b) fol- 
lows from the determinant identity \I m + AB\ = |7 n + BA\. 
Therefore, the gap per transmitter is upper-bounded by 



^<log{2(M-l)}. 
Claim 1: K S \s° < \S\{1 - p 2 )!^. 



(22) 



Proof: Starting with the fact that any covariance matrix 
is positive semidefinite, we get 

K s]S c < trace (K S \s-) I\s\ 



(a) 



= E{^i^}%i * E 

(6) 



max {K Xm \x„} I\s\ 



£ 1 



) I\ S \ < \S\ (l - p 2 ) I\ S \ 



where (a) follows from the fact that K Xm \s" < K Xm \x n f° r 
some n e 6> c ; and (6) is because we set p = min mj „ p m n- ■ 
Similarly we define 5 sum = (| — (fTB")) . We then get 



A/ 



A I 



<*sum < log 1 + <^ E VSNR„ lfc [ - log 1 + E SNR 
\ [m=l J / \ m=l 

(a) / M \ / M \ 

< log I 1 + M E SNR„ lfe - log 1 + E SNR mfe 

\ m— 1 / \ m— 1 / 

<logM 



where (a) follows from the Cauchy-Schwarz inequality. There 
fore, the gap per transmitter is upper-bounded by 

4um log M 

M ~ M 



<log{2(M-l)}. 



(23) 



(20) j n j s com pi e tes the proof. 



Appendix C 
Converse Proof of TheoremO 

First, consider ([T8V Starting with Fano's inequality, we get 



' M 



ink 



N ^ Rm-e N \ < J(Wi,--- ,^ M ;^ V ) 

\m=l / 
(a) ^ (6) 

< E H ( Y ki) ^ A r max{ni fc , ■ • • , n M fc} 

where (a) follows from the fact that conditioning reduces 
entropy; and H(Yki) is maximized when (Xu, ■ ■ ■ ,Xmi) are 
uniformly distributed and independent. 

Next, consider dlTb . Let Ws ■= {W m ■ m E S}. Starting 
with Fano's inequality, we get 

AHE^-^J <I(W s ;Y n ,W S c) 

® I(Ws',Y N \W S c) ® E^l^,^- 1 ,^^) 

(c) „ (d) 

< 22 H i Y i\ x s*,i) < Arank(G 5 ) 

where (a) follows from the fact that Ws and Ws? are 
independent; (6) follows from the fact that X Sc is a func- 
tion of (Ws*, Yf -1 , ■ ■ ■ ,Yj£ _1 ); (c) follows from the fact 
that conditioning reduce entropy; (d) follows from the fact 
that H(Yi\Xs<=.i) is maximized when (Xu,--- ,XMi) are 
uniformly distributed and independent. 
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